# Indonesian Pretraining

A BERT base model pretrained on Indonesian Wikipedia using Masked Language Modeling (MLM) objective, case insensitive.

IndoBERT is a state-of-the-art language model developed for Indonesian based on the BERT architecture, trained using Masked Language Modeling (MLM) and Next Sentence Prediction (NSP) objectives.

Indonesian masked language model based on RoBERTa architecture, trained on the OSCAR corpus with a validation accuracy of 62.45%

IndoBERT is an advanced Indonesian language model based on BERT, trained with Masked Language Modeling (MLM) and Next Sentence Prediction (NSP) objectives.

IndoBERT is a BERT model variant tailored for the Indonesian language, trained using masked language modeling and next sentence prediction objectives. The Lite version is a lightweight model suitable for resource-constrained environments.